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Abstract 

We set out a general procedure which allows the approximation of certain Markov 
chains by the solutions of differential equations. The chains considered have some 
components which oscillate rapidly and randomly, while others are close to determin- 
istic. The limiting dynamics are obtained by averaging the drift of the latter with 
respect to a local equilibrium distribution of the former. Some general estimates are 
proved under a uniform mixing condition on the fast variable which give explicit error 
probabilities for the fluid approximation. 

Mitzenmacher, Prabhakar and Shah |8j introduced a variant with memory of the 
'join the shortest queue' or 'supermarket' model, and obtained a limit picture for 
the case of a stable system in which the number of queues and the total arrival 
rate are large. In this limit, the empirical distribution of queue sizes satisfies a 
differential equation, while the memory of the system oscillates rapidly and randomly. 
We illustrate our general fluid limit estimate in giving a proof of this limit picture. 

Keywords. Join the shortest queue, supermarket model, supermarket model with mem- 
ory, law of large numbers, exponential martingale inequalities, fast variables, correctors. 
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1 A general fluid limit estimate 

We describe a general framework to allow the incorporation of averaging over fast variables 
into fluid limit estimates for Markov chains, building on the approach used in [2]. The 
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main results of this section, Theorems 11.51 and II. 6^ estabhsh exphcit error probabihties for 
the fluid approximation under assumptions which can be verified from knowledge of the 
transition rates of the Markov chain. See also [1] for related results. 

1.1 Outline of the method 

Let X = {Xt)t^Q be a continuous-time Markov chain with countable state-space S and with 
generator matrix Q = {q{^,0 : G S"). Assume that the total jump rate g(^) is finite 
for all states ^, and that X is non-explosive. Then the law of X is determined uniquely by 
Q and the law of Xq. Make a choice of fluid coordinates : S* — > M, for i = 1, . . . ,d, and 
write X = {x^, . . . ,x'^) : S — t- W^. Consider the M'^-valued process X = {Xt)t^Q given by 
Xf = {X^, . . . , Xf) = x{Xt). Call X the slow or fluid variable. Define for each ^ G S* the 
drift vector 

Make also a choice of auxiliary coordinate y : S ^ I, for some countable set /, and set 
Yt = y{Xt). Call the process Y = {Yt)t^Q the fast variable. For ^ E S and y' E I with 
y' 7^ ^(0' "write 7(.^, y') for the total rate at which Y jumps to y' when X is at C,. Thus 

7(e,i/')= E ^(^'^')- 

Choose a subset U of M'^ and a function b : U x I ^ M°'. Choose also, for each x E U, 
a generator matrix = {g{x,y,y') : y,y' G /) having a unique invariant distribution 
Tlx = {n{x,y) : y E I). These choices are to be made so that f3{^) is close to b{x{^),y{^)) 
and ■j{C,,y') is close to g{x{^),y{^),y') whenever x{^) G U and y' G /. Define for x G ?7 

H^) = ^b{x,y)'^ix,y). 

Then, under regularity assumptions to be specified later, there exists a function x '■ U xl ^ 
M'^ such that 

Gxix, y) = ^ gix, y, y')x{x, y') = b{x, y) - b{x). (1) 
y'ei 

Make a choice of such a function x- Call x the corrector for b. 

Fix xq G U. We will assume that b is Lipschitz on U. Then the differential equation 
Xt = b{xt) has a unique maximal solution {xt)t<c iii U starting from xq. Fix to G [0,^)- 
Then for t ^ to 

Xt = Xo+ / b{xs)ds. (2) 
Jo 
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Define for ^ e S' witli x{^) e U 

s(0 = x(0-x(^(0,y(0)- 

Let T a stopping time sucli tliat Xt G U for all t ^ T. Then, under regularity assumptions 
to be specified later, for t 

x{Xt) = x{Xo) + Mt+ [ P{X,)ds (3) 

where M = is a martingale and where 

P = Qx = l3-Q{x{x,y)). (4) 
On subtracting equations (j2]) and ([3]) we obtain for t ^ T A to 

Xt-Xt = Xo-Xo + x{Xt, Yt) - x(Xo, Yo) + + f A{X,)ds 

Jo 

+ [ {^{Xs)-b{Xs,Ys))ds+ [ {b{Xs)-b{xs))ds (5) 
Jo Jo 

where A = Gxix, y) - Q{xix, y))- 

The discusson in the present paragraph is intended for orientation only, and will play 
no essential role in the derivation of our results. Fix f/o C f/ such that for all C,,^' ^ S with 
x{^) G Uq and q{C,,C,') > we have x{C^') G U. Assume that T is chosen so that Xt G Uq 
for all t ^ T. Define for ^ G S* with x{^) G Uq the diffusivity tensor a{^) G M"' ® M"' by 

aHo = - ^-m^'io - ^'iom^o (6) 

and define for t 



Nt = Mt®Mt- f a{Xs)ds. 
Jo 



Then, under regularity assumptions, is a martingale in M*^ (8> K'^. Choose a function 
a : f/o X J ^ R'^ (g) R'' and set 

d{x) = ^a{x,y)Tr{x,y). 

This choice is to be made so that a{^) is close to a(a;(^), whenever x{^) G Uq. Suppose 
we can find also a corrector for a, that is, a function x : Uq x I ^ ^ such that 

Gxix,y) = a{x,y) -d{x). (7) 
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Then, for t ^ T, 

a{Xs)ds = x{Xt,Yt)-x{X^,Y^)-Mt+ [ A{Xs)ds 

Jo 

+ [ {a{X.,)-a{X,,Ys))ds+ [ a{X,)ds (8) 
Jo Jo 

where A = Gx{x,y) — Q{x{x,y)) and, under suitable regularity conditions, M = is a 
martingale up to T. 

The martingale terms M and M in ([S]) and ([S]) can be shown to be small, under suitable 
conditions, using the following standard type of exponential martingale inequality. In the 
form given here it may be deduced, for example, from [21 Proposition 8.8] by setting / = 6(p, 
A = and B = 65. 

Proposition 1.1. Let (p be a function on S. Define 

Mt = Mf = 0(Xi) - 0(Xo) - / Q<P{Xs)ds. 

Jo 

Write J = J{(f)) for the maximum possible jump in (pi^X), thus 

J= sup 

C,5'e5,g{C,5')>o 

Define a function a = a"^ on S by 

Then, for all 5, £ G (0, oo) and all stopping times T, we have 

P (^supMt and a{Xt)dt ^ ^ exp {-5V(2£e^'^)} 

where 9 G (0, oo) is determined by 6*6^"^ = 5/e. 

Now, if /3,7,a are well approximated by b,g,a and if we can show that the corrector 
terms in and (|H]) are insignificant, then we may hope to use these equations to show 
that the path [xt : t ^ to) provides a good (first order) approximation to {Xf : t ^ to) and 
moreover that the fluctuation process {Xt — Xt : t ^ to) is approximated (to second order) 
by a Gaussian process {Ft : t ^ to) given by 

Ft = Fo + Bt+ [ Vb{xs).FJs 
Jo 
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where {Bf : t ^ to) is a. zero-mean Gaussian process in M.'^ with covariance 

rsAt 

E{Bs ®Bt)= / a{xr)dr. 
Jo 

Our aim in the rest of this section is to give an exphcit form of the first order approximation 
with optimal error scale, that is, of the same order as the scale of deviation predicted by 
the second order approximation. The next subsection contains some preparatory material 
on correctors. A reader who wishes to understand only the statement of the fluid limit 
estimate can skip directly to Subsection 11.31 

1.2 Correctors 

In order to implement the method just outlined, it is necessary either to come up with 
explicit correctors or to appeal to a general result which guarantees the existence, subject 
to verifiable conditions, of correctors with good properties. In this subsection we obtain 
such a general result. In fact, we shall find conditions which guaranteee the existence, for 
each bounded measurable function f on U x /, of a good corrector for /, that is to say a 
function x = x/onf/ xJ such that 

Gx{x,y) = f{x,y) - f{x) 

where 

fix) = ^f{x,y)Tr{x,y). 
yei 

Moreover we shall see that Xf depends linearly on / and we shall obtain a uniform bound 
and a continuity estimate for Xf- 

Assume that there is a constant u G (0, oo) such that, for all x G f/ and all y & I, 
the total rate of jumping from y under does not exceed u. Then we can choose an 
auxiliary measurable space E, a family of probability measures /i = {fi^ '■ x & U) on E, and 
a measurable function F : I x E ^ I such that, for all x E U and all ?/, y' G / distinct, 

g{x, y, y') = ufx^{{v G E : F{y, v) = y'}). (9) 

Let = {N{t) : t ^ 0) be a Poisson process of rate u. Fix x E U and let V = {Vn : n eN) 
be a sequence of independent random variables in E, all with law /i^.. Thus 

gix,y,y') = uFiFiy,Vr,)=y') 

for all pairs of distinct states y, y' and all n. Fix a reference state y E I. Given y E I, set 
Zf) = y and Zq = y and define recursively for n ^ 
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Set Yt = ZN{t) and Yf = Z]^{t)- Then Y = (Yf)t^Q and Y = (Fj^^o are both Markov chains 
in I with generator matrix G^, starting from y and y respectiveljl^, and are reahzed on 
the same probabihty space. We call the triple (z/, fi, F) a coupling mechanism. Define the 
coupling time 

% = inf{t ^ : Ft = Yt}. 
Assume that, for some positive constant r, for all a; G f/ and all y,y & I, 

mix, y, y) = E^x,y,y) (Tc) ^ T. (10) 

Fix a bounded measurable function / on f/ x / and set 

x(x,y)=E(.,,) r\f{x,Yt)-f{x,Yt))dt. (11) 

Then x is well defined and, for all x G f/ and all y & I, 

\x{x,y)\^2r\\f\U (12) 
Proposition 1.2. The function x a corrector for f. 

Proof. We suppress in the proof the variable x. Note first that if instead of taking Zq = y 
we start Z randomly, with the invariant distribution vr, then we change the value of x 
by a constant independent of y. Hence it will suffice to establish the corrector equation 
Gx = f — f this case. Fix A > and define 



iy) = E [ ' f{Yt)dt, 0" = E / ' f{Yt)dt 
Jo Jo 



where Tx = Ti/A, with Ti an independent exponential random variable of parameter 1. 
Then, since Y and Y coincide after T^, 



\y) = E / (/(F,) - f{Yt))dt ^ x{y) 
Jo 

as A — 7- 0. By elementary conditioning arguments, (G — A)0'^ + / = and A0^ = /, so 

(G-A)(0^-0^) = /-/. 

On passing to the limit A — )■ in this equation, using bounded convergence, we find that 
Gx = / — /, as required. □ 



^The process Y introduced here is not the fast variable, also denoted Y in the rest of the paper: the 
current Y is to be considered as a local approximation of the fast variable. 
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We remark that the corrector .) in fact depends only on /, and the choice of 
as the preceding proof makes clear. The further choice of a coupling mechanism is a way 
to obtain estimates on x- 

The following estimate will be used in dealing with the A term in equation ([5]). Write 
ll/^x — A^x'll for the total variation distance between and fix'- 

Proposition 1.3. For all x,x' ^ U and all y E I , 



Proof. By a standard construction there exists a sequence of independent random variables 
{{Vn, : n E N) in E X E such that Vn has distribution fi^, has distribution /i^./ and 
^(^ri 7^ Vn) — 1 11/^2^ " f^x'W, for all n. Write {J^t)t^o foi' the filtration of the marked Poisson 
process obtained by marking N with the random variables {Vn, V^). Construct (Y, Y) from 
and {Vn : n G N) as above. Similarly construct {Y', Y') from and {V^ : n eN). Recall 
that Tc = inf{t ^ : Yt = Yt} and set T,' = inf{t ^0:1"/ = F/}. Set A = iz/||/i^. - 



Then the process t h- )■ Ij^i^t} — At is an (J^t)jj.o-supermartingale and Tc is an (J^Jt^o-stopping 
time. So, by optional stopping, we have F{D ^ T^) ^ AE(Tc) ^ Ar. Moreover, by the 
strong Markov property, on {D ^ Tc}, we have E(Tc — D\J^d) = m{x. Yd, Y^) ^ r so, for 
any function g : I ^ R"', with \g\ ^ ||/||oo; 



\x{x,y) - x{x',y)\ ^ 2rsup \f{x,z) - f{x',z)\ + 2z/r^||/||oo||/U:, - ^x'\\- 



(13) 



and set 



D = M{t;,0:{Y„Y,)^{Y:,Y:)}. 



E 




On the other hand. 




so 




oo 
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We apply this estimate with g = f{x,-) to obtain 



\x{x,y) - x{x',y)\ 



E l^\fix,Yt)-f{x,Yt))dt-E r\fix'X)-fix'X))dt 

^0 



^ 2rsup \f{x,z) - f{x\z) 



E I ^ f{x,Yt)dt-E I ^ f{xX)dt 

^0 



+ 



E [ ' /(x, Yt)dt -E [ ^ fix, Yl)dt 
Jo Jo 

^ 2t sup \f{x,z) - f{x',z) \ +2z/r2 



as required. 

To summarize, we have shown the following: 



□ 



Proposition 1.4. Assume conditions ^ and HJ^) . Then, for any bounded measurable 
function f on U x I, there exists a corrector Xf for f satisfying the estimates IH^) and 

m 



1.3 Statement of the estimates 



Recall the context of Subsection 11.11 We consider a continuous-time Markov chain X with 
countable state-space S and generator matrix Q. We choose fluid coordinates x : S ^ M.'^ 
and an auxiliary coordinate y : S ^ I. We choose also a subset U C M*^, which provides a 
means of localization, together with a map b : U x I ^ M*^, and a family G = [G^ : x & U) 
of generator matrices on J, each having a unique invariant distribution vr^;. Choose also, as 
in the preceding subsection, a coupling mechanism for G. This comprises a constant z/ > 0, 
an auxiliary space E, a function F : I x E ^ I and a family of probability distributions 
/i = {fix : X E U) on E such that 

gix, y, y') = i^IJ-xHv G E F{y, v) = y'}), X eU, y,y' e I distinct. 



Define for x eU 



K^) = ^Kx,y)TTix,y)- 



Write Xt = x{Xt) and assume that {xt)o^t^to is a solution in U to Xt = b{xt). We use a 
scaled supremum norm on W^: fix positive constants cxi, . . . , 0"^ and define for x G M"^ 



X = max Xj /(Ti. 
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We introduce now some constants A, B,t, J, Ji{b), J{fi), K which characterize certain 
regularity properties of Q, b, and G. Assume that, for all ^ G S", all x G ?7 and all y, y' G /, 

g(e)^A, \\b{x,y)\\^B, m{x,y,y') ^ r. (14) 

Here m(x, y, y') is the mean coupling time for starting from y and y', defined in the 
preceding subsection, which depends on the choice of coupling mechanism. Write J for 
the set of pairs of points in U between which X can jump, thus 

J = {{x,x') xU ■.x = x{i),x' = x{^') for some e S with q{^, > 0}. 

Set 

J= sup Jiip) = sup \\b{x,y) -b{x\y)\\, J{lj) = sup - /Ux'H- 

(x,x>)&j (x,x')ej,yei (x,x')ej 

Write K for the Lipschitz constant of 6 on f/: thus, for all x, x' G t/, 

^{x)-b{x')\<,K\x-x'\\. (15) 

Recall from Subsection 11.11 the definitions of the drift vector /3 for x and the jump rate 7 
for y. Define 

T = inf{t ^ : Xf ^ t/}. 

Fix constants 5(/3, 6), 5(7, g) G (0, 00) and consider the events 

^(/3,&)= / \\mt)-Kx{X^),y[X,))\\dt<,b{fi,b)\ (16) 



and 

/ ^ |7(X„|/')-^7(^TO,Z/ra,i/')M^^%,^?) >• (17) 

Theorem 1.5. Let e > 6e g'Zi'en and sei 5 = ee~'^*"/7. Assume that J ^ e and 

max{||Xo -xoll, 5(/3,6), 2TB5{-f,g), 2tB, 2AtoiTJi{b) + i^T^BJ{fi))} ^5. 

Set J = J + AtB and assume that 6 ^ AJto/A. Assume further that the following tube 
condition holds: 

forces and t ^ to, - Xt\\ ^ 2£ =^ x{^) G U. 

Then 

p(sup||Xt-xt|| >e] ^2de-^^/^^^^^'°^ + F{n{^,byun{-f,gy). 



9 



The reader will understand precisely the role of the inequalities which appear as hy- 
potheses in this result by following the proof. Here is an informal guide to their meanings. 
The tube condition, together with J ^ e, allows us to localize the other hypotheses to U by 
trapping the process inside a tube around the limit path: these conditions can be satisfied 
by choosing U sufficiently large. The conditions ||Xo — 2;o|| ^ <^ and 6{P,b) ^ 6 enforce 
that the initial conditions and drift fields match closely. This requires in particular that the 
fiuid and auxiliary coordinates provide sufficient information to nearly determine /3. The 
condition on 5(7, g) forces a close match between the local behaviour of the fast variable 
and the idealized fast process used to compute the corrector. The condition 2tB ^ 6 al- 
lows us to control the size of the corrector, balancing the mean recurrence time of the fast 
variable r against the range of the drift field b. The condition on 2Ato(TJi(6) + ur'^BJ^fi)) 
is needed for local regularity of the corrector, allowing us to pass back from the idealized 
fast process at one point x to the actual fast variable when the fiuid variable is near x. 
Finally the condition 6 ^ AJto/4 ensures we are in the 'Gaussian regime' of the exponential 
martingale inequality, where bad events cannot occur by a small number of large jumps. 
For a non-trivial limiting dynamics, A J should be of order 1, while for a useful estimate 
A should be small - thus, as expected, we can attempt to use the result when the Markov 
chain takes small jumps at a high rate. 

It is sometimes possible to improve on the constant AJ^ appearing in the preceding 
estimate, thereby obtaining useful probability bounds for smaller choices of e. However, 
to do this we have to make hypotheses expressed in terms of a corrector. Fix |/ G / and 
denote by x the corrector for b given by fill I) . Define for ^ G 5 with G U 

Define, for ,^ G S* such that x{^) G U and x{C^') G U whenever q{C,,C,') > 0, 

Note that, since we shall be interested only in upper bounds, we deal here only with the 
diagonal terms of the diffusivity tensor defined at Choose functions : I [0, 00) 
such that, for all ^ G f/ where is defined, 

a\0^(^\yiO), ^ = l,...,d. (18) 

For simplicity, we do not allow a to depend on the fiuid variable x{^). Since we can localize 
our hypotheses near the (compact) limit path, we do not expect to lose much precision by 
this simpification. On the other hand, by permitting a dependence on the fast variable we 
can sometimes do significantly better than Theorem II. 5[ as we shall see in Section [2l Set 

dix) = ^ a{y)Tr{x, y), x e U. 

y€l 
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We introduce two further constants A and A, with A ^ A ^ AJ^. Assume that, for all 
X G f/ and all y & I, 

a\y)^Aal a\x) ^ Aal z = l,...,d. (19) 

Note that the corrector bound ffT^ gives \\xix{^),y{^))\\ ^ 2tB, so ^ J^J'^crf and 

so ([19]) holds with A = A = AP and a*(?/) = Aaf and a*(x) = Aaf. Thus Theorem O 
follows directly from ( 120|) below. The new inequalities required on the left side of (12T]) can 
be understood roughly as imposing that the ratio of the averaged diffusivity to a uniform 
bound on the diffusivity is not too small compared to the mean recurrence time of the fast 
variable - so an effective averaging takes place. 

Theorem 1.6. Assume that the hypotheses of Theorem \1.5\ hold and that 5 J ^ Ato/A. 
Then 

P (sup \\Xt -xt\\>e] ^ 2rfe"^'/(^^*o) + P(fi(/3, hf U ^(7, gf). (20) 
Moreover, under the further conditions 6 J ^ Ato/4 and 

-max{r, T6{-f,g), Mqut'^ J (fi)} ^ A/{20A) ^ At (21) 

we have 

P fsup \\Xt - XtW >e] ^ 2de-^'/(^^*«) + 2de-(^/^)'*o/(6^°°^"')+P(l](/3,6)"Ul](7,^)'=). (22) 

Proof. Consider the stopping time 

To = inf{t ^ : \\Xt - Xt\\ > e}. 

By the tube condition, we have Tq ^ T. Moreover, for any t <Tq and any ^' ^ S such that 
q{Xt,C,') > 0, we have 

-Xt\\^J + \\Xt -xt\\ ^ 2e 

so by the tube condition cc(^') G U . 

Recall that x is the corrector for h given by f lTT]) . For the proof of fl2^ . we shall use 
( ITT|) to construct also a corrector x for o-- Set 5 = Ato/lO. Note from ( !T2|) the bounds 

||x(x,y)|| ^ 2rfi ^ 5, \r{x,y)\ ^ 2rAa^ <: la}. 

The inequality involving b and further such inequalities below, which depend on the first 
inequality in assumption f l2T]) . will not be used in the proof of fl20|) . Write A = Gx{x-, y) — 
Qixix, y)) = Ai + A2 and A = Gx{x, y) - Q{x{x, y)) = Ai + A2, where 

Ai(0= ^9{x{i)Mi),y')-l{U)}x{x{i),y') (23) 
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and 

and where Ai and A2 are defined analogously. Then, on ^(7, (7), for t ^ T A to, 

ft 



(24) 



and, using Proposition ll.3[ 



Similarly, for t ^ T A to 



A\{Xs)ds 



and 



Take M = as in equations (|3]) and ([5]) and consider the event 



n{M) = < sup II Mill ^5\. 

Then, on Q{/3, h) fl ^2(7, ^f) fl r2(M), we can estimate the terms in equation (j5]) to obtain for 
To A to, 

\\Xt-Xt\\^15 + K j \\Xs-Xs\\ds 
Jo 

so that II — a:t|| ^ £ by Gronwall's lemma. Note that this forces To ^ to and hence 
supj^^ij ||Xt — a:t|| ^ £. Set p = 3 A/2 and consider the event 



n{a) 



TiiAto 



a\Ys)ds ^ pto<^j^ for i = I, ■ ■ ■ ,d 



By condition (fT8|) . on Q{a) we have 



ToAto 



Set 



Ji = J{x' 



sup \x\0-^\^% l = l,...,d 
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and use (fT^ to see that Jj ^ JcTj. Determine 9i G (0, oo) by Oie^^-^^ = S/{ptQai); then 
^ ^/(p^oC"i), so 6'jJj ^ 25j/(3/lto) ^ 1/4, since we assumed that 6 J ^ Since 
gi/4 ^ 4^3^ have pe^'"'* ^ 2^4. We now apply the exponential martingale inequality, 
Proposition II. H substituting ±a;* for (p for i = 1, . . . ,d and substituting ^cTj for 6 and ptoO"j^ 
for e. We thus obtain 

P(l](Af)^ n n{a)) ^ 2de-^'/(^^*o). 

If we take A = A, then, using (fT8l) and (fT9l) . we have f2(a) = f2, so the proof of (l20l) is now 
complete. 

Set ?7 = 16Ar^y4^. We shall complete the proof of f l22|) by showing that 

Take M as in equation ([H]), with a as in ( llSp . Then, for t ^ T, 

r a(n)t;s = x{Xt, Yt) - x{Xo, Yo) - Mt + f A{Xs)ds + f a{X,)ds (25) 
JO Jo Jo 

where A = Gx{x,y) — Q{x{x,y)). Consider the event 



n{M) = < sup \Ml\ ^5af for t = l,...,d}. 
Then, on Q{'y,g) fl Q{M), we can estimate the terms in equation ( 125|) to obtain 

'•ToAio 

a%Ys)ds ^ {56 + Ato)a^ ^ ptoal 



Hence it will suffice to show that 

P(fi(M)") ^ 2rfe-^'/(^^*o). 

For this, we use again the exponential martingale inequality. Take (j){C,) = ±x^{x{^),y{^)) 
in Proposition 11.11 and note that a'^{C,) ^ IGAr'^A'^af, so 

/•ToAio 

/ a'f'{Xs)ds ^ IGAr^A^afto = ritual 
Jo 

Set 

J, = J(0)= sup 10(0-0(01, i = l.....d 

then Ji < ArAaf. Determine Oi e (0, oo) by ^jC^'-^' = S/{r]toaf). Then 9i ^ 6/{r]toaf) so 
ft/Ji ^ A/{40AtA) ^ 1/2 and so e^'"^» ^ 2. Hence 

P(n(M)'=) ^ 2dexp|-5V(2r/toe''-^0} ^ 2de-^'/(^^*o) 
as required. □ 
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2 The supermarket model with memory 



The supermarket model with memory is a variant, introduced in [8], of the 'join the shortest 
queue' model, which has been widely studied O |3l IH [5l IH [7] . We shall verify rigorously the 
asymptotic picture for large numbers of queues derived in [8]. This will serve as an example 
to illustrate the general theory of the preceding sections. The explicit form of the error 
probabilities in Theorem 11.61 is used to advantage in dealing with the infinite-dimensional 
character of the limit model. 

Fix A G (0, 1) and an integer n ^ 1. We shall consider the limiting behaviour as — ?■ oo 
of the following queueing system. Customers arrive as a Poisson process of rate A^A at a 
system of single-server queues. At any given time, the length of one of the queues is kept 
under observation. This queue is called the memory queue. On each arrival, an independent 
random sample of size n is chosen from the set of all N queues. For simplicity, we sample 
with replacement, allowing repeats and allowing the choice of the memory queue. The 
customer joins whichever of the memory queue or the sampled queues is shortest, choosing 
randomly in the event of a tie. Immediately after the customer has joined a queue, we 
switch the memory queue, if necessary, so that it is the currently shortest queue among 
the queues just sampled and the previous memory queue. The service requirements of all 
customers are assumed independent and exponentially distributed of mean 1. 

Write = Z^''^ for the proportion of queues having at least k customers at time t, and 
write Yt for length of the memory queue at time t. Set Zt = {Z^ : A; G N) and Xt = {Zf, Yt). 
Then X = {Xt) t^o is a Markov chain, taking values in 5* = 5*0 x Z,"*", where 5*0 is the set of 
non-increasing sequences in N~^{0, 1, . . . , A^} with finitely many non-zero terms. We shall 
treat F as a fast variable and prove a fluid limit for Z as A^ — >■ oo. 

2.1 Statement of results 

Let D be the set of non-increasing sequence^ z = {zk : k E N) in the interval [0, 1] such 
that 

'm{z) := Zk < oo. 

k 

Define for z E D and G N 

*'(-.'^) = nr3^ (26) 

where 

Pk~i{z) = n{zk-i - Zk)zl~'^ 

^To lighten the notation, we shall sometimes move the coordinate index from a superscript to a subscript, 
allowing the nth power of the kth. coordinate to be written z^. We shall also write the time variable 
sometimes as a subscript, sometimes as an argument. 
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and where we take Zq = 1. Set fi{z, 0) = 1 for all z. An elementary calculation shows that 
in the case n ^ 2 

pu-i{z) ^ (1 - l/ny-^ <: < ^ (27) 

In the case n = 1 we have pk-i{z) = Zk-i — Zk ^ 1 and it is possible that 0/0 appears 
in the product (1261) . For definiteness we agree to set 0/0 = 1 in this case. Note that 
k) ^ k + 1) for all k ^ 0. Define for z & D 

Vk{z) = \z]^_^fi{z, k-1) - \zl^i{z, k) - {zk - Zk+i) 

and consider the differential equation 

z{t) = v{z{t)), t ^ 0. (28) 

By a solution to (1281) in D we mean a family of differentiable functions Zk '■ [0, oo) — t- [0, 1] 
such that for all t ^ and € N we have {zk{t) : A; G N) G -D and 

hit) = Vk{z{t)). 

Theorem 2.1. For all z{0) G D, the differential equation z{t) = v{z{t)) has a unique 
solution in D starting from z{f]). Moreover, if {w{t) : t E D) is another solution in D with 
2^fc(0) ^ ^i^fc(O) for all k, then Zk{t) ^ Wk{t) for all k and all t ^ 0. 

There is a fixed point of these dynamics a E D given by setting ao = 1 and defining 

Ofc+i = Aa^7i(a, /c), ^ 0. (29) 
The components of a decay super-geometrically. Set 



Then a G (2n,2n + 1). 
Theorem 2.2. We have 



« = n + ^ + Jn2 + i (30) 



lim — log log ( — \ = a. 



fc-^oo k Ko-k 



Assume for simplicity that we start the queueing system from the state where all queues 
except the memory queue are empty and where the memory queue has exactly one customer. 
Write {z{t) : t ^ 0) for the solution to (l28l) starting from 0. Then Zk{t) ^ for all k and 
t. Our main result shows that {z{t) : t ^ 0) is a good approximation to the process of 
empirical distributions of queue lengths {Z^{t) : t ^ 0) for large A^. The sense of this 
approximation is reasonably sharp. In particular, as a straightforward corollary, we obtain 
that, on a given time interval [0, to], for any r > a~^, with high probability as A^ — oo, no 
queue length exceeds r log log A^. 
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Theorem 2.3. Set n = (2a) ^ and define 



d = d{N) = snp{k G N : Nak > N^}. 

Fix a function (p on N such that (f){N)/N'^ — )■ and log (j){N) / loglog N — t- oo as — oo. 
Set p = 4/(1 — A) when n = 1 and set p = 2"/(l — e~^/^) when n ^ 2. Set dd+i = 
A^-^aS + p%+i. Then 

lim d(iV)/loglogiV = 1/a. (31) 

iV->-oo 

Moreover, for all to ^ 0, we have 



lim P I sup sup ^ 1 = (32) 

N^oo \ti:to k^d VOfc V A' 



and 

7N,d+l 



and 



lim limsupP(Z( ' ^ R^d+i for some t ^ to) = (33) 

lim P(Zf = for all t ^ to) = 1. (34) 

The argument used to prove this result would apply without modification starting from 
any initial condition z{0) for the limit dynamics (128|1 such that Zk{0) ^ for all k, with 
suitable conditions on the convergence of Z^(0) to z{0). It may be harder to move beyond 
initial conditions which do not lie below the fixed point. We do note here however a family 
of long-time upper bounds for the limit dynamics which might prove useful for such an 
extension. Fix j G N and define a^"'^ = a(fc_j)+ for each k G then a^-'-' is a fixed point of 
the modified equation 

Wk(t) = Vk{w{t)) + {Wj{t) - Wj+i{t))l{k=j}. 

Since the added term is always non-negative, a similar argument to that used to prove 
Theorem 12.11 in the next subsection shows also that, if z(0) ^ a'--'^ and {z{t) : t ^ 0) is a 
solution of the original equation, then z(t) ^ a^^^ for all t. 



2.2 Existence and monotonicity of the limit dynamics 

The differential equation (!28|) characterizes the limit dynamics for the fiuid variables in 
our queueing model. Our analysis of its space of solutions will rest on the exploitation of 
certain non-negativity properties which have a natural probabilistic interpretation. 

We consider first a truncated, finite-dimensional system. Fix (i G N and define a vector 
field u = u^'^^ on D by setting Uk{z) = Vk{z) for /c ^ d — 1 and 

Ud{z) = Xz2_ip{z, d- 1) - Xz2p{z, d) - Zd (35) 

and Ukiz) = ioi k^ d+1. Set D{d) = {(xi, . . . , x^, 0, . . . ) : ^ ^ . . . ^ Xi ^ 1}. 
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Proposition 2.4. For all x(0) G D{d), the differential equation x{t) = u{x(t)) has a 
unique solution {x{t) : t ^ 0) in D{d) starting from x(0). 

Proof. In the proof, we consider D{d) as a subset of R''. The function u is continuous on 
D{d) and is differentiable in the interior of D{d) with bounded partial derivatives. (In the 
case n = 1, the singularity in {d/dxj)fi{x,k) for j ^ k as Xj^i — — )■ 1 is cancelled by 
the factor Xk by which it is multiplied, since Xk ^ Xj on D{d).) For x G D{d) we have 
ui{x) ^ when xi = 1, and Ud{x) ^ when Xd = 0. Moreover, for /c = 1, . . . , ci — 1, if 
Xk = Xk+i then Pk{x) = so 

Uk+i{x) = k)—fi{x, k+l)) ^ k)—n{x, k+l) ^ x'^_ifj.{x, k—l)—x'^fi{x, k) ^ Uk{x). 

The conclusion now follows by standard arguments. □ 

Proof of Theorem \2.1[ Suppose that {w{t) : t ^ 0) is a solution to w{t) = v{w{t)) in 
D starting from w{0), with z{0) ^ u^(0), that is to say Zk{0) ^ Wk{0) for all k. Fix 
d and write x{t) = z^^\t) for the solution to x{t) = u^^\x{t)) in D{d) starting from 
(zi(0), . . . , Zd{0), 0, 0, . . . ). Set y{t) = {wi{t),..., Wd{t), 0, 0, ... ) and note that x(0) ^ y{0) 
and y{t) G D{d) for all t. We shall show that x{t) ^ y{t) for all t. Consider now D{d) as a 
subset of M''. We have 

where = (0, . . . , 0, 1). Note that w'^+\t) ^ for all t. Now M is Lipschitz on D{d) and 
foT k = 1, . . . , d we can show that0 

x,yeD{d), x^y, Xk = yk =^ Uk{x)^Uk{y). 

Hence by a standard argument z^'^^t) = x{t) ^ y{t) ^ w{t) for all t. The same argument 
shows that z'^'^^t) ^ z'^'^^^^t) for all t, so the limit Zk{t) = Mmd^oo zlf\t) exists for all k 
and t, and z{t) ^ w(t) for all t. 

Fix k and take d ^ /c + 1. Then the following equation holds for all t 

4'^W+ fxzf{s)y{z^'\s),k)ds+ f zf{s)ds 
Jo Jo 

= ZkiO)+ [ Xz^l,{srfiiz^''\s),k-l)ds+ I zfl^{s)ds. 
Jo Jo 

^ An elementary calculation shows that /i(a;, j) ^ /i(y, j) for all j whenever x ^ y. This will also be shown 
by a soft probabilistic argument in Subsection 12.61 The ftirther condition Xk = yk gives the inequality 

Vk-i - x^-i ^ niyk-i - Xk-i)xl-^ = pk-iiy) - Pk-i{x) ^ - - 

l-Pk-i(y) l~pk-i[x) 
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On letting c? — > oo, we see by monotone convergence that 

Zkit) + / Xzk{s)"-iJ,{z{s),k)ds + / Zk{s)ds 
Jo Jo 

= Zk{0) + / Xzk-i{s)''iJ,{z{s),k - l)ds + I Zk+i{s)ds. 



Since z(t) G D for all t, all integrands in this equation are bounded by 1. It is now 
straightforward to see that {z(t) : t ^ 0) is a solution. 
Now 

^fe(^) + / Xwk{s)^fi{w{s),k)ds + / Wk{s)ds 
Jo Jo 

= Wk{0)+ / Awfe_i(s)"/i(w(s), A; - + / Wk+i{s)ds. 
Jo Jo 

By summing these equations over G {1, . . . , c/} we see that the map t i— )■ Ylt=i '^k{t) — Xt 
is non-increasing for all d. Hence m{w{t)) ^ m(w(0)) + Xt < oo. The equations can then 
be summed over all k and rearranged to obtain 

m(-u;(t)) = m(w(0)) + At — / wi{s)ds. 

Jo 

On the other hand 

m{z^''\t)) = m{z^''\0)) + Xt - f z[^\s)ds - X f zf\s)''fi{z^''\s),d)ds 

Jo Jo 

so ^ 

m{wit))-m{z^'^\t)) ^m{w{0))-m{z^'^\0)) + X I z^isY n{z{s),d)ds. (36) 

Jo 

If u'(O) = 2(0) then the right hand side tends to as — 00 so we must have z{t) = w{t) 
for all t. □ 

2.3 Properties of the fixed point 

Recall the definition (129|1 of the fixed point a. Since /i(a, k) ^ 1 for all k, we have 



so Ofc — >■ as — )■ 00. Theorem 12.21 is then a straightforward corollary of the following 
estimate. 
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Proposition 2.5. There is a constant C{X,n) < oo such that, for all k ^ 0, 

C-^al ^ afc+i ^ Cal (37) 

where a is given by equation ((23) ■ 



Proof. Note that, since Oi = A, we have pk-i{a) = Ok-i — ^ A V (1 — A) < 1 for all k 
when n = 1. On the other hand equation fl7r|) gives pk-i{z) ^ e~^/^ for all k when n ^ 2. 
Then from Xlfc^iPfc-il*^) ^ 1? we obtain a constant c < oo, which may depend on A when 



n = 1, such that 



Then for A; ^ 



so for k ^ 1 



oo « 

TT — — 



- ^ c. 



fc-i fc-i 



^ a,^, ^ cal^^'a-,!!,. (38) 
Note that Xa^ = X = ai ^ X~^a^. Fix A^l/X and suppose inductively that 

On using these inequalities to estimate ak-i in ( 138|) . we obtain 

(cA"/")-^a^ ^ afc+i ^ cA"/"a^ 

where we have used the fact that 1 — n/a = a — 2n. Hence the induction proceeds provided 
we take A ^ c°/("-"). □ 

2.4 Choice of fluid coordinates and fast variable 

In the remaining subsections we apply Theorem 11.61 to deduce Theorem 12.31 Define d as 
in Theorem 12.31 and take as auxiliary space J = N when n = 1 and / = Z+ when n ^ 2. 
Make the following choice of fluid and auxiliary coordinates: for ^ = {z,y) E S with 
z = {zk'. k e N), set 

x''{0 = Zk, k = l,...,d, y{0 = y- 

Thus our fluid variable is Xt = x{Xt) = {Z^, . . . , Zf) and our fast variable is Yt = y{Xt). 
Note that when n = 1, if Iq ^ 1 then 1 for all t, so Y takes values in / = N. 

Let us compute the drift vector /3(^) for X when X is in state ^ = {z,y) G S. Note 
that X^ makes a jump of size 1/N when a customer arrives at a queue of length k — 1, and 
makes a jump of size —1/N when a customer departs from a queue of length k, otherwise 
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is constant. The length of the queue which an arriving customer joins depends on the 
length of the memory queue y and on the lengths of the sampled queues. Denote the vector 
of sampled queue lengths hyV = V{z) = {Vi, . . . , K) and write V^^^ ^ l/^^) ^ . . . ^ -j/C^) 
for the ordered queue lengths. Define min(u) = f i A ■ ■ ■ A w„ and set M = min{V). Then 
M = 1/(1) and 

P(M ^k) = zl. 

A new customer will go to a queue of length at least k if and only if M ^ /c and y ^ k. So 
the rate for an arrival to a queue of length exactly A; — 1 is 

iVAP(M ^k- l)l{y^k^i} - iVAP(Af ^ k)l{y^j,}. 

The rate for a departure from a queue of length k is N{zk — Zk+i)- Hence, setting zq = 1, 
we have 

= ^^k-l^{y^k-l} — — {Zk — Zk+l)- 

We now compute (an approximation to) the jump rates 7(.^, y') for Y when X is in 
state ^ = (2, y) G 5*. The rate of departures from the memory queue is at most 1. Arrivals 
to the system occur at rate A^A. Occasionally, the memory queue falls in the sample, an 
event of probability no greater than n/N and hence of rate no greater than An. Assuming 
that the the memory queue does not fall in the sample, the length of the memory queue 
after an arrival is given by 

F{.y, V) = {y + + yl{M<iy^p} + Pl{y^p+i} (39) 

where P = p{y) is given by P = M + 1 when n = 1 and P = (M + 1) A V'-^-' otherwise. 
Hence we have 

\l{U)-N\nny.V{z))=y')\^l + \n. (40) 

2.5 Choice of limit characteristics and coupUng mechanism 

Define 

f/ = {x e M'^ : ^ ^ . . . ^ xi ^ 1 and xi ^ (A + l)/2 and Xk ^ 2afc for all k}. 

The condition xi ^ (-^ + l)/2 ensures that 1 — xi is uniformly positive on U. Define 
: f/ X Z+ ^ M'^ by 

fefc(x, y) = Axfc„il{y^fc_i} - Axfcljy^fc} - (xfc - Xfc+i) (41) 

where we set Xq = 1 and Xd+i = 0. Then, for ^ G S* with x{^) G t/ we have 

/3(O = K=«(O,y(O) + (0,...,0,^,+i). (42) 
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It is convenient to specify our choice of the generator matrices {G^ : x & U) and our 
choice of couphng mechanism at the same time. Set v = NX and take as auxihary space 
E = (Z"*")". Define a family of probabihty distributions fi = {fix '■ x E U) on E, taking fi^ 
to be the law of a random sample V = V{x) = {Vi, . . . , Vn) with 

F{Vi^k) = --- = P(K ^k)=Xk 

for A; = 0, 1, . . . , ci + 1. Note that 

d 

ll/ix - /ix'll ^ |xfe - (43) 

k=l 

Then define for distinct y,y' E Z"*" 

g{x,y,y') = NXF{F{y,V{x)) = y') 

where F is given by fl39p . We take as coupling mechanism the triple {v,^,F). 

Note that F[y, v) = F{y, v) for all y,y E I whenever p{v) = min /. For x E U we have 

¥{p{V{x)) = 1) ^ 1 - xi > ^—^ 

2 

when n = 1, whereas for n ^ 2 we have 

F{p{V{x)) = 0) ^ (l-xiY > 

Hence we obtain, in all cases, m{x,y,y) ^ r, where we set 

4 

For ^ E S with x = x{^) E U we can realize a sample V{z) (from the distribution 
of queue lengths) and the sample V{x) on the same probability space by setting Vi{x) = 
Vi{z) A d. Write M{x) = mm{V{x)) and P(x) = p{V{x)). Then M(x) = M{z) A d and 
P{x) = P{z) A {d + 1) when n = 1 and P{x) = P{z) A d when n ^ 2. The difference 
between the two cases is that there is no second shortest queue in the sample when n = 1. 
We have, for n = 1, 

F{P{z) + P{x)) ^ P(M(^) ^ d + 1) = Zrf+i 

and, for n ^ 2, 

F{P{z) ^ P{x)) ^ ¥{P{z) ^d+1)^ nzdZ^'l 
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Now P{x) = P{z) implies M{x) = M{z) and hence F{y,V{x)) = F{y,V{z)) for all y. 
Hence 

P(F(y, V{z)) + F{y, V{x))) ^ P(P(a;) ^ P{z)). 
On combining this with ( 140|) we obtain 

J2 |7(e,l/0 1/(0, 1/01 ^1 + An + 7VAn^rf+i. (44) 
2.6 Local equilibrium distribution 

The Markov chain determined by the generator has a unique closed communicating 
class, which is contained in {0, 1, . . . ,d}. Hence has a unique equilibrium distribution tTx, 
which is supported on {0, 1, ... , d}. Consider a continuous-time Markov chaiii§ Y = {Yt)t^o 
with generator Gx, and initial distribution Hx- Set = P(lo ^ k). Then F jumps 

into {0, 1, ... , k} from j at rate a = NX{1 — x"^^^ — Pk{x)), for all j ^ k + 1. On the other 
hand, Y jumps out of {0, 1, . . . ,k} only from k, and that at rate /3 = NXx^^^. Since the 
long run rates of such jumps must agree, we deduce that afi{x, A; + 1) = I37ix{k). Hence we 
obtain 

H{x, + 1)(1 - Pk{x)) = k) 

and so 

Kx,k) = l\- k = l,...,d. (45) 

Hence our present notation is consistent with the definition (1261) . Note also that, for z E 
fi{z, k) depends only on Zi, . . . , 2;^; in particular if x = (zi, . . . , 2;^) then ii{z, k) = ^{x, k) 
for all k ^ d. Note that b is given by 

bk{x) = \xl__^fi{x,k - 1) ~ Xx'lfi{x,k) - {xk - Xk+i), k = l,...,d (46) 

where Xq = 1 and Xd+i = 0. Hence b = u^'^^ as defined in Subsection 12. 2[ 
A comparison of fl5Sl) and fHT]) now shows that b = u^'^\ 

Recall that p = 4/(1 — A) when n = 1 and that p = 2"/(l — e~^/^) when n ^ 2. Then 
for X E U and k ^ 1 we have 

fj,{x, k) = xlfi{x, k - 1)/ (1 - Pfc-i(x)) ^ palp{x, k - I) ^ P(4f^{x, k - 1)/ (1 - Pfc-i(a)) 

so, for all X G f/ and inductively for all /c ^ 1, we obtain 

/i(x, fc) ^ p''n{a,k). (47) 



*See footnote O 
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The following argument shows that fi{z, k) ^ fi{z', k) for all k whenever z ^ z'. Fix 
d ^ k and set x' = (2^, . . . , 2;^). Assume that x ^ x' . By a standard construction we can 
realize samples V = V{x) and V = V{x') on a common probability space such that Vi ^ l^' 
for all i. Then we can construct Markov chains Y and Y', having generators Gx and Gx' 
respectively, on the canonical space of a marked Poisson process of rate NX, where the 
marks are independent copies of (V, V), as follows. Set Yq = ^0 ~ ^ define recursively 
at each jump time T of the Poisson process Yt = F{Yt-, Vt) and Y^ = F{Y^_, V^), where 
{Vt, V^) is the mark at time T. Then, since F is non- decreasing in both arguments, we see 
by induction that Yt ^ y/ for all t. Hence, by convergence to equilibrium, 

fi{z, k) = fi{x, k) = lim F{Yt ^ A;) ^ lim P(F/ ^ k) = fi{x', k) = fi{z', k). 

2.7 Corrector upper bound 

We take as our reference state y = mini and note that, under the coupling mechanism, we 
have Yt ^ Yt for all t. Then the kth component of the corrector for b is given by 

Jo 

so for X eU and all y G / we have 

\Xk{x,y)\^rxl_,^Cal_jN. 

Fix now y ^ k — 2 and consider the stopping time T = inf{t : Yt = k — 1}. Note that 
Y can enter state k — 1 only from k — 2 and does so at rate NXx'^_^, whereas occurs 
in state A; - 2 at rate at least iVA(l - Xf/i. Hence Py(T ^ ^ Ca'^_^ and so, by the 
Markov property, 

E, / ' l{%<k~i^Y4ds ^ E,(l|T^T.}m(x, k-l, Yt)) ^ Cal_,r ^ Cal_jN. 
Jo 

Hence we obtain, for x E U and all y G /, 

\Xkix,y)\ ^ C{aUky;.k-i} + at,)/N. (48) 

2.8 Quadratic variation upper bound 

The growth rate at ^ of the quadratic variation of the corrected /cth coordinate is given by 
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Recall that Xk = Xk — Xk{x,y). We estimate separately, writing x = x{^) and y = y{C)y 
Y^ixkiC) - XkVqi^,^) ^ N~\Nxk + NXxUky^k-i}) 

and 

When y ^ k — 2 we can improve the last estimate by splitting the sum in two and using 

E {xk{x{e),y{e)) - xk{x.y)rqi^,a ^ cN-^xt, 

and 

E {xkixie),y{e))-xk{x,y)rq{^,a ^ cN-^xt,. 

We used fHSl) for the first inequality and for the second used 

E q{i.O^CNxl_,. 

On combining these estimates we obtain 
where 

afc(|/(0) = C{ak + aLil{,^fc_i})/iV. 
Then, using the estimate (H7|) and the limit (pTl) . we have 

afc(x) = C(afc + A; - 1)) ^ Cp^'^afc/iV ^ C{\ogNfak/N 

so we have for all x G t/ and ?/ G / 

with A = C/(iVai""^") and A = C{logNf'/N. It is straightforward to check that, for N 
sufficiently large, we have A ^ A ^ AJ^. 
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2.9 Truncation estimates 

A specific feature of tlie problem we consider is tliat tlie limit dynamics is infinite-dimensional, 
while the general fluid limit estimate applies in a finite-dimensional context. In this subsec- 
tion we establish some truncation estimates which will allow us to reduce to finitely many 
dimensions. 

Let {z{t) : t ^ 0) be the solution in D to z{t) = v{z{t)) starting from 0, as in Theorem 
Let : t ^ 0) be the solution to x{t) = b{x(t)) starting from 0. 



1- 



Lemma 2.6. We have 

d 

^ \Zk{t) - ^ tCrf^ 

k=\ 

Proof. Since b = u'^'^\ we have x{t) = z^^\t) for all t, and so, from f p6|l we obtain 

d d „t 



k=l k=l -^0 



Zd{sYjji{z{t),d)ds ^ tXa2fi{a,d) = tfld+i- 



□ 



Denote by Ak{t) the number of arrivals to queues of length at least k by time t. Note 
that iVZf+^ ^ Afc(t) for all k ^ I and all t. Recall that 

dd+i = N-^a^^ + p'^ad+i. 

Lemma 2.7. There is a constant C{X,n) < oo such that, for allt ^ and all N, we have 

E(A,(TAt)) ^Ce^*iVfi,H_i. 

Proof. Consider the function f on U x I given by f{x,y) = l{y^d} and note that f{x) = 
fi{x, d). Let X be the corrector for / given by ( iTTl) . Then, for all x ^ U and all y G / 

\x{x,y)\^2T\\f\\^ = 2T = CN-' 

and, whenever x = x{^) and x' = x{C^') with > 0, by the estimates (|T3i) and (143|) . 

\x{x,y) - x{x',y)\ ^ 2uT^\\f\U\fi, - fi,,\\ ^ CN-\ (49) 

By optional stopping. 



TAt 



Q{x{x,y)){X,)ds 



\E{xiXTM,YTAt) - xiXo,Yo))\ ^ CN~\ 



Now 

Qixix, y)m = ky^d} - K^iO, d) - Ai(0 - A2(0 
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where Ai, A2 are given by (1251) . (^^. We use to obtain the estimate 

|Ai(0| ^ 2r(l + An + iVAnZd+i) = + iV-^) 

and from fH9|) deduce that 

|A2(0I ^ + A)CA^-2 = CN-\ 

So 

r-TAi ;-TAi 



E 



I>1 At /- J At 

/ l{Y.^d}ds ^ CN-' + E / d) + CZ,^+^ + CN-') ds. 

Jo Jo 



\.ds 



Set g{t) = E{Ad{T A t)), then 

/•TAt /-TAt 

g{t) = N\E / (X,")n|y^>4rfs ^ NXTa'^E / l|y^^,}t 
JO Jo 

^CaS (^1 + J^{Np''fi{a,d) + l + g{s))ds^ CNda+iil + t) + C g{s)ds. 

Here we have used the estimate fi(x, d) ^ p'^fi{a, d) for x eU . The claimed estimate now 
follows by Gronwall's lemma. □ 

Fix R G (0, 00) and define 

f = inf{t ^ : Ad{t) ^ i^A^a^+i} A T. 

Lemma 2.8. There is a constant C(A, n) < 00 such that, for allt ^ and all N, we have 

E(Ad+i(f A t)) ^ C{1 + t)i?"52+i + Cti?"+^iV5S+\ 

Proof. We argue as in the preceding proof, except now taking /(x, y) = l^^y^d+i}, for which 
/(x) = 0. We obtain 



i-TAt pTAt 

Jo Jo 



E 

and hence 



/•J At 

E(A,+i(r A t)) = iVAE / iZ^^'r^Y.^,+,yds 

Jo 

j-TAt 

^ NXiRdd+iTE / l{Y^^d+i}ds ^ C(l + t)i?"a2+i + Cti?"+^iVa^+J. 
Jo 



□ 



26 



2.10 Proof of Theorem [2731 

Recall that a is defined by fl30|) and that a e (2n, 2n + 1). Note that — (2n + l)a + n = 0. 
Recall that k = (2a) ~^ and 

d = d{N) = snp{k G N : iVofe > A^'^}. 

The asymptotic growth rate fl3T|) follows from Theorem 12.21 We shall use without further 
comment below the inequalities 

proved in Proposition 12.51 and the inequalities 

a,+i ^ iV"(i"'') ^ flrf, log log N, 

the last being valid for all sufficiently large A^. 

By the truncation estimate, Lemma 12. 6^ we have 



sup sup 



Since 0(A^) — > oo as — > oo it will therefore suffice to show (132|) with (^(t) : t ^ 0) 
replaced by : t ^ 0). 

We apply the general procedure of Subsection 11.31 Take as norm scales cr^ = ^Jak so 
that 



|a;|| = max |xfc|/-\/afc, a; G 

k 



nd 



We now identify suitable regularity constants A, B, r, J, Ji{b), J(/i), -ft'. We write C for a 
finite positive constant which may depend on A and n and whose value may vary from line 
to line. We shall see that, as A^ — >■ oo, the inequalities between these regularity constants 
required in Theorem 11.61 become valid. The maximum jump rate is bounded above by 

A = A^(l + A) = CN. 

We refer to the form of b{x, y) given at (14T|) and note that, for x G f/ and y & I, 

\\b{x,y)\\ ^B = 2"a;'/'+"/" = Ca, 

We showed in Subsection 12.51 the following upper bound on the mean coupling time of our 
coupling mechanism 



27 



We refer to Subsection 11.31 for the definitions of the jump bounds J, Ji{b), J{ji) and leave 
the reader to check the vahdity of the following inequalities 

J ^ N~^a~^'\ J,{b) ^ CiV"ia;'/'+("-')/", J(/i) ^ 2nN-\ 

Recall from (146|) the form of b. In estimating the Lipschitz constant K for b on U, note 
first that, for x G f/ and for j = 1, . . . , k — 1, 



Here we have used the explicit form ( 126|) of A; — 1) and the fact that (1— ^ ^ C 
on t/. Note also the inequalities 



We find after some further straightforward estimation that we can take K = C. 
Recall the choice of function in the statement of Theorem I2.3[ Set 

^=y^' 5 = ^e-^*V7, S{P,b) = 5, 5{^,g) = 5/i2rB). 

Recall that Xq = {1/N, 0, . . . , 0) and Xq = and that the driving rate u for the coupling 
mechanism is equal to A^A. It is now straightforward to check that all the inequalities 
required in the statement of Theorem 11.51 are valid, for all sufficiently large A^. 

We now check the tube condition of Theorem 11.51 The inequalities ^ x^iO ^ • • • ^ 
Xi(^) ^ 1 hold for all ^ G S. By a monotonicity property established in the proof of 
Theorem 12. H we have Xk{t) ^ for all t ^ and for k = l,...,d. Hence, for 
sufficiently large, if \\x{^) —x{t)\\ ^ 2e for some t ^ 0, then x'^(^) ^ a/^ + 2e^/ak ^ 2afc and 
x\^) ^ ai + 2ey/a^ ^ A + (1 - A)/2 ^ (1 + A)/2, so a3(0 G t/ and the tube condition is 
satisfied. 

We turn now to the extra conditions needed to apply Theorem II. 6[ We noted in 
Subsection 12.81 the quadratic variation bounds 

ttkiy) ^ Aal, ak{x) ^ Aal 

valid for all x E U and y E I, where 

A = C/(iVa;-"/"), A = C{\ogNf/N 

and where A ^ A ^ A for sufficiently large A^. It is now straightforward to check, also for 
A'^ sufficiently large, that the remaining inequalities required in the statement of Theorem 
11.61 hold. Theorem 11.61 therefore applies to give 

r(snp\\Xt-Xt\\ >e) ^2rfe-''/(^^*») + 2de-(^/^)'*»/(^^°°^^')+P(fi(/3,6)^Ufi(7,^7)^) (50) 
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Now, for sufficiently large, we have d ^ log log and, by our choice of and k, 

S'/iAAto) > 0(iV)/((logiV)%) ^ logiV 

and 

{A/A)%/{QAOOAt^) ^ logiV. 

Hence the first and second terms on the right hand side of (!50|) tend to as — )■ oo. 

Recall from ( !T6|) and (fT7|) the form of the events Q{P,b) and Q{'j,g). In the present 
example, the complementary exceptional events arise either as a result of truncation or 
because of finite effects in the fast variable dynamics, as shown by the equation fl42p and 
the estimate (jS]). Recall that 6{l3,b) = 6 and S{-f,g) = 6/{2tB). Then 

niP.by C y^"^'' ^dt ^ C |a,(T Ato) > ^^^} • (51) 

It is straightforward to check that, for all sufficiently large A^, S{'-f,g) ^ 2to(l + An), which 
implies that 



6 



^il,9r^\ I (1 + An + NXnZr')dt ^ ^(7, g) } C \ A,(T A to) > ^^^^^^j^ | • (52) 

To see that ¥{n{(3,by U ^(7,^)') ^ as A^ cx) we use the bound on E{AdiT A to)) 
proved in Lemma 12.71 and Markov's inequality. It then suffices to show that in the limit 
A^ 00, 



C(a2 + p'^Ara,+i)e^*» < 



4rato 

For the term involving a"^ this is easy. For the other term, involving Na^-^i, we can check 

that in fact 

Nad+i < ^ (logAT)^ < VW^. 

This completes the proof of ( l32l) . The limit ( 133|) follows immediately from Lemma l2n using 
Markov's inequality. Finally note that, as A^ — )■ 00, 

dd+i ^ CN-^a'l + (log A^)^arf+i ^ C{N~^ + (log A^)^A^-i+^) ^ 

and 

NoJ'^Xl ^ C(A^-(^-^)("+^)/" + (logA^)^A^^-(^-'^)("+^)) ^ 0. 
Then the limit (!34|) follows from ( l33l) and Lemma [2.81 using Markov's inequality. □ 
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2.11 Monotonicity of the queueing model 

We prove here a natural monotonicity property of the supermarket model with memory 
which is a microscopic counterpart of the monotonicity of solutions to the differential 
equation fl28l) shown in Theorem I2.1[ We do not rely on this result in the rest of the paper. 

First we construct, on a single probability space, for all ^ = {z, G 5, a version 
X = X{^) oi the supermarket model with memory starting from ^. Set yi = yi{C,) = y and 
determine yi = yi{i) G Z"*" for i = 2, . . . , iV by the conditions 

1/2 ^ . . . ^ 2/7V, Zk = \{ie{l,...,N}:y,^k}\/N, A; G N. 

We work on the canonical space of a marked Poisson process of rate A^(l + A), where 
the marks are either, with probability 1/(1 + A), independent copies of a uniform random 
variable J in {1, . . . , A^} or, with probability A/(l + A), independent copies of a uniform 
random sample ( Ji, . . . , J„) from {1, . . . , A^}. Fix ^ = {z,y) & S and define a process 
X = X{i) = {Xt : t ^ Q) in S as follows. Set Xt = I for all t < T, where T is the 
first jump time of the Poisson process. If the first mark is a random variable, J say, take 
the sequence yi, . . . ,yN and replace yj by {yj — 1)+ to obtain a sequence ui, . . . ,un say; 
set yi = ui and write U2, ■ ■ ■ ,un in non-decreasing order to obtain ^2 ^ • • • ^ Vn- If the 
first mark is a random sample, (Ji, . . . , J„) say, select components {y^ : i E {1, Ji, . . . , J„}) 
and write these in non- decreasing order, wi ^ ... ^ Wm say; replace Wi by t^i + 1 and 
write the resulting sequence again in non- decreasing order, vi ^ . . . ^ Vm say; set yi = Vi 
and write V2, ■ ■ ■ ,Vm combined with the unselected components {yi : i ^ {1, Ji, . . . , J„}) in 
non-decreasing order to obtain ^2 ^ • • • ^ Vn- Set Xt = {{Z!^ : G N), Yt), where 

= |{^ G {1, . . . , iV} : ^ k}\/N, keN, YT = yi 

and repeat the construction from Xt in the usual way. 

For e, r e ^ write ^ ^ ^' ii y^iO ^ Vii^') for 2 = 1, . . . , iV. 

Theorem 2.9. Let E S with ^ ^ Then Xt{^) ^ Xj(^') for all t ^ 0. 

Proof. It will suffice to check that the desired inequality holds at the first jump time T, 
that is to say, with obvious notation, that yi ^ y[ for all i. Note that if ^ hi for all i for 
two sequences (ai, . . . , a„) and {pi, ... , hn) then the same is true for their non-decreasing 
rearrangements. In the case where the first mark is a random variable J, since yi ^ y[ for 
all i, we have Ui ^ u[ for all i and so yi ^ y[ for all i. On the other hand, when the first 
mark is a random sample (Ji, . . . , J„), we have Wj ^ w'^ for all j, so Vj ^ v'^ for all j, and 
so yi ^ y[ for alH. □ 
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